Predicting Visual Overlap of Images Through Interpretable Non-Metric Box Embeddings

To what extent are two images picturing the same 3D surfaces? Even when this is a known scene, the answer typically requires an expensive search across scale space, with matching and geometric verification of large sets of local features. This expense is further multiplied when a query image is evaluated against a gallery, e.g. in visual relocalization. While we don't obviate the need for geometric verification, we propose an interpretable image-embedding that cuts the search in scale space to essentially a lookup. Our approach measures the asymmetric relation between two images. The model then learns a scene-specific measure of similarity, from training examples with known 3D visible-surface overlaps. The result is that we can quickly identify, for example, which test image is a close-up version of another, and by what scale factor. Subsequently, local features need only be detected at that scale. We validate our scene-specific model by showing how this embedding yields competitive image-matching results, while being simpler, faster, and also interpretable by humans.Comment: ECCV 202

Duckietown: An Innovative Way to Teach Autonomy

Teaching robotics is challenging because it is a multidisciplinary, rapidly evolving and experimental discipline that integrates cutting-edge hardware and software. This paper describes the course design and first implementation of Duckietown, a vehicle autonomy class that experiments with teaching innovations in addition to leveraging modern educational theory for improving student learning. We provide a robot to every student, thanks to a minimalist platform design, to maximize active learning; and introduce a role-play aspect to increase team spirit, by modeling the entire class as a fictional start-up (Duckietown Engineering Co.). The course formulation leverages backward design by formalizing intended learning outcomes (ILOs) enabling students to appreciate the challenges of: (a) heterogeneous disciplines converging in the design of a minimal self-driving car, (b) integrating subsystems to create complex system behaviors, and (c) allocating constrained computational resources. Students learn how to assemble, program, test and operate a self-driving car (Duckiebot) in a model urban environment (Duckietown), as well as how to implement and document new features in the system. Traditional course assessment tools are complemented by a full scale demonstration to the general public. The “duckie” theme was chosen to give a gender-neutral, friendly identity to the robots so as to improve student involvement and outreach possibilities. All of the teaching materials and code is released online in the hope that other institutions will adopt the platform and continue to evolve and improve it, so to keep pace with the fast evolution of the field.National Science Foundation (U.S.) (Award IIS #1318392)National Science Foundation (U.S.) (Award #1405259

Path planning for underwater information gathering based on genetic algorithms and data stochastic models

Recent technological developments have paved the way to the employment of Autonomous Underwater Vehicles (AUVs) for monitoring and exploration activities of marine environments. Traditionally, in information gathering scenarios for monitoring purposes, AUVs follow predefined paths that are not efficient in terms of information content and energy consumption. Informative Path Planning (IPP) represents a valid alternative, defining the path that maximises the gathered information. This work proposes a Genetic Path Planner (GPP), which consists in an IPP strategy based on a Genetic Algorithm, with the aim of generating a path that simultaneously maximises the information gathered and the coverage of the inspected area. The proposed approach has been tested offline for monitoring and inspection applications of Posidonia Oceanica (PO) in three different geographical areas. The a priori knowledge about the presence of PO, in probabilistic terms, has been modelled utilising a Gaussian Process (GP), trained on real marine data. The GP estimate has then been exploited to retrieve an information content of each position in the areas of interest. A comparison with other two IPP approaches has been carried out to assess the performance of the proposed algorithm

Simultaneous Drag Reduction and Kinetic Energy Density of the Plane Poiseuille Flow

[Departement_IRSTEA]Ecotechnologies [TR1_IRSTEA]SPEEInternational audienceWe present in this paper a closed-loop approach to control the 2D plane Poiseuille flow in an unstable state. To do that, we propose to use a vision-based approach as proposed in our previous paper on this subject to estimate the state of the flow. The first step is based on the evaluation of the 2D velocity field from optical flow measurements. These measurements are next used into a visual servo control scheme. However, since we are interested in the simultaneous minimization of two quantities, that is the drag and kinetic energy density of the flow, we propose to design a control law based on an advanced visual servo control approach, the so-called partitioned visual servo control, first proposed in the robotics community. Simulations results validate our control scheme, including the case where noisy measurements are considered. We also compare our approaches with the most relevant ones